Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rust): add env locked metadata functions #16719

Merged
merged 1 commit into from
Jun 6, 2024

Conversation

coastalwhite
Copy link
Collaborator

This prepares for further use of the metadata. This locks several functionalities of the metadata behind the POLARS_METADATA_FLAGS environment variable when compiling on debug-mode. This is either 0 to disable all metadata, or extensive and log possibility delimited by ,. This enables further experimental features like extensive use of the metadata and logging of every time the metadata is used.

@github-actions github-actions bot added enhancement New feature or an improvement of an existing feature rust Related to Rust Polars labels Jun 4, 2024
@ritchie46
Copy link
Member

And CI is failing. You have a lint error.

Copy link

codecov bot commented Jun 5, 2024

Codecov Report

Attention: Patch coverage is 54.80519% with 174 lines in your changes missing coverage. Please review.

Project coverage is 81.38%. Comparing base (9912af0) to head (df86903).
Report is 29 commits behind head on main.

Files Patch % Lines
...ates/polars-core/src/chunked_array/metadata/mod.rs 50.57% 128 Missing ⚠️
...ates/polars-core/src/chunked_array/metadata/env.rs 47.61% 22 Missing ⚠️
.../polars-core/src/chunked_array/metadata/collect.rs 16.66% 20 Missing ⚠️
crates/polars-core/src/chunked_array/mod.rs 85.18% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #16719      +/-   ##
==========================================
- Coverage   81.49%   81.38%   -0.11%     
==========================================
  Files        1416     1415       -1     
  Lines      186880   186429     -451     
  Branches     3023     2776     -247     
==========================================
- Hits       152289   151729     -560     
- Misses      34059    34180     +121     
+ Partials      532      520      -12     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

This prepares for further use of metadata. This locks several functionalities
of the metadata behind the `POLARS_METADATA_FLAGS` environment variable when
compiling on `debug`-mode. This is either `0` to disable all metadata, or
`extensive` and `log` possibility delimited by `,`. This enables further
experimental features like `extensive` use of the metadata and `log`ging of
every time the metadata is used.
Copy link

codspeed-hq bot commented Jun 5, 2024

CodSpeed Performance Report

Merging #16719 will improve performances by 15.86%

Comparing coastalwhite:metadata-env-lock (df86903) with main (616b2e0)

Summary

⚡ 1 improvements
✅ 36 untouched benchmarks

Benchmarks breakdown

Benchmark main coastalwhite:metadata-env-lock Change
test_tpch_q11 4.5 ms 3.9 ms +15.86%

@ritchie46 ritchie46 merged commit 875906e into pola-rs:main Jun 6, 2024
21 checks passed
@coastalwhite coastalwhite deleted the metadata-env-lock branch June 6, 2024 06:47
@c-peters c-peters added the accepted Ready for implementation label Jun 9, 2024
Wouittone pushed a commit to Wouittone/polars that referenced this pull request Jun 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
accepted Ready for implementation enhancement New feature or an improvement of an existing feature rust Related to Rust Polars
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

3 participants